PROSPECTIVE ABNORMAL SHADOW DETECTING SYSTEM^ AND 
METHOD OF AND APPARATUS FOR JUDGING WHETHER PROSPECTIVE 
ABNORMAL SHADOW IS MALIGNANT OR BENIGNANT 



BACKGROUND OF THE INVENTION 
Field of the Invention 
This invention relates to a system for detecting a 
prospective abnormal shadow in a radiation image on the basis 
of image data representing the radiation image. This 
invention also relates to a method of and an apparatus for 
judging whether a prospective abnormal shadow is malignant or 
benignant . 

Description of the Related Art 
In the medical field and the like, there are cases where 
radiation image data is obtained from a radiation image of an 
object recorded on a photographic film, stimulable phosphor 
sheet and the like, suitable image processing is carried out 
on the image data and an image is reproduced on a display on 
the basis of the processed image data. Recently there have 
been developed various computer-aided digital image 
processing techniques, and there have been put into practice, 
as a device for forming a diagnostic image, various image input 
devices (image forming modality) such as a CT (computed 
tomography) apparatus, a MR I (magnetic resonance imaging) 
apparatus, a CR (computed radiography) apparatus and the like. 

The digital image processing techniques are basically 



different from the conventional analog image processing 
techniques in that the digital image processing techniques can 
quantitatively analyze image data. For example, there has 
been proposed an abnormal shadow detection processing 
5 technique called CADM (computer-aided diagnosis of medial 
image) which detects an abnormal shadow representing a growth, 
a micro calcification or the like by positively making use of 
the merit of the digital image processing technique. See, for 
instance, "Growth Shadow Detection in a DR image (Iris Filter) " 

10 (Journal of Academy of Electronics/Information/Communication 
D-II, vol. J75-D-II No. 3, pp663 to 670, Mar. 1992) and 
"Extraction of Micro Calcification Shadow by a Morphology 
Filter using multiple Structural Elements" (Journal of Academy 
of Electronics/lnf ormation/Communication D- II , vol. J75-D-II 

15 No. 7, ppll70 to 1176, Jul. 1992). 

In the abnormal shadow detection processing, the digital 
image signal is analyzed by a computer to automatically detect 
a prospective abnormal shadow which is conceivable to 
represent a growth, a micro calcification or the like, and the 

20 detected prospective abnormal shadow is marked to call 
attention of the reader, or the probability that the 
prospective abnormal shadow represents a genuine abnormality 
or the feature value or the index on the basis of which the 
part of the image is determined to be a prospective abnormal 

25 shadow is output, whereby a certain detecting level can be 
ensured irrespective of the skillfulness of the reader and 
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overlooking or misreading can be suppressed. 

We, this applicant, have proposed a prospective abnormal 
shadow detecting system, for instance, in U.S. Patent No. 
5,761,334 and Japanese Patent Application 2000-038298, in 
5 which a prospective abnormal shadow indicating existence of, 
for instance, mammary cancer is automatically detected by the 
use of an iris filter or a morphology filter on the basis of 
a mammogram or a breast radiation image and the prospective 
abnormal shadow part of the image is enhanced or enlarged. 
J^jlO Then the processed (e.g., enhanced or enlarged) prospective 
% Z abnormal shadow part is displayed over the overall image or 

'f% the probability that the prospective abnormal shadow 

represents a genuine abnormality and/or the feature value or 
JL the index on the basis of which the part of the image is 

' : ;f, 15 determined to be a prospective abnormal shadow is displayed 

in addition to the overall image. 
^ When the iris filter is used, the density gradients (or 

the brightness gradients) in the image are represented by 
gradient vectors and a part of the image where the degree of 
20 convergence of density (signal value) gradient vectors is high 
is determined to be a prospective abnormal shadow, whereby a 
prospective shadow of growth inherent to the breast cancer can 
be automatically detected. In the processing using the 
morphology filter, a part which fluctuates in density in a space 
25 narrower than multiple structural elements selected according 
to the size of the abnormal shadow to be detected is determined 
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to be a prospective abnormal shadow, whereby a prospective 
shadow of micro calcification inherent to breast cancer can 
be automatically detected. 

We, this applicant, have further proposed improving 
5 accuracy of the prospective abnormal shadow detection 
processing by detecting the prospective abnormal shadow using 
an evaluation function value such as a Mahalanobis distance 
as disclosed, for instance, in U.S. Patent No. 5,732,121. 

However, though outputting a prospective abnormal 

10 shadow portion such as a prospective growth shadow and a 
prospective micro calcification shadow, the previously 
proposed abnormal shadow detection techniques do not output 
information on whether the abnormality represented by the 
prospective abnormal shadow is malignant or benignant. 

15 For example, if only the prospective abnormal shadow 

detection processing using the iris filter or the morphology 
filter or additional processing for improving the accuracy is 
carried out, the prospective abnormal shadows representing the 
malignant and benignant abnormalities are both enhanced. 

20 This can deteriorate the diagnostic efficiency since 

prospective abnormal shadows representing unmalignant 
abnormalities are output together with those representing 
malignant abnormalities. 

When prospective abnormal shadows are detected by the 

25 use of the iris filter or the morphology filter, prospective 
abnormal shadows which are conceivable to be malignant are 
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separated from those which are conceivable to be benignant 
(will be respectively referred to as "malignant prospective 
abnormal shadow" and "benignant prospective abnormal shadow", 
hereinbelow) on the basis of a morphological feature, and only 
5 malignant prospective abnormal shadows are detected as final 
prospective abnormal shadows as disclosed in U.S. Patent No. 
5,761,334, Japanese Patent Application No. 2000-038298, and 
"Distinguishment between benignant and malignant micro 
calcification clusters in a breast X-ray image"; papers of 
G10 medical image engineering academy "JAMIT Frontier '99 pp. 89 
%Q to 93, only malignant prospective abnormal shadow is output 

W as an image and benignant prospective abnormal shadow is not 

4= output as an image. However, since a benignant abnormality 

« can change to a malignant abnormality, it is not preferred that 

CO 15 only malignant prospective abnormal shadow be output as an 
!=& image but it is rather preferred that a suggestion to the effect 

m that the part corresponding to the benignant prospective 

abnormal shadow is to be kept watched be output together with 
the image of the malignant prospective abnormal shadow. 
2 0 That is, none of the conventional systems outputs 

information sufficiently effective to diagnosis as a result 
of the automatic detection of the prospective abnormal shadow. 
That is, in order to enhance effectiveness of the result of 
the automatic detection of the prospective abnormal shadow as 
25 information for assisting the reader in reading the radiation 
image, it is preferred that information on whether the 
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prospective abnormal shadow is malignant or benignant be 
output . 

SUMMARY OF THE INVENTION 
In view of the foregoing observations and description, 

5 the primary object of the present invention is to provide a 
prospective abnormal shadow detecting system which detects a 
prospective abnormal shadow in a radiation image and outputs 
information on the prospective abnormal shadow in a manner in 
which whether the prospective abnormal shadow is malignant or 

0 benignant can be distinguished, thereby enhancing 
effectiveness of the result of the automatic detection of the 
prospective abnormal shadow as information for assisting the 
reader in reading the radiation image. 

Another object of the present invention is to provide 

5 an improved method of and an improved apparatus for judging 
whether a prospective abnormal shadow is malignant or 
benignant . 

In accordance with a first aspect of the present, there 
is provided a prospective abnormal shadow detecting system 

0 comprising a prospective abnormal shadow detecting means which 
detects a prospective abnormal shadow in an image on the basis 
of image data representing the image and a prospective abnormal 
shadow information output means which outputs information on 
the prospective abnormal shadow detected by the prospective 

5 abnormal shadow detecting means, wherein the improvement 
comprises that a malignancy judging means which judges whether 
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the prospective abnormal shadow detected by the prospective 
abnormal shadow detecting means is malignant or benignant is 
provided and the prospective abnormal shadow information 
output means outputs the information on the prospective 
5 abnormal shadow in such a manner that whether the prospective 
abnormal shadow is malignant or benignant as judged by the 
malignancy judging means can be distinguished. 

The information on the prospective abnormal shadow may 
be an image representing the prospective abnormal shadow (may 
j=|10 have been subjected to image processing such as contraction, 
3 enlargement, frequency- enhancement processing or 

l~i sharpness- enhancement processing) or values representing the 

i/j position, shape and/or size of the prospective abnormal shadow, 

f-j It is preferred that the prospective abnormal shadow 

□15 information ( the information on the prospective abnormal 
U shadow) bears thereon the position of the prospective abnormal 

r ~ shadow in the overall image. It is suitable to output a 

malignant prospective abnormal shadow and a benignant 
prospective abnormal shadow in sequence in a predetermined 
20 order. 

As the information bearing thereon the position of the 
prospective abnormal shadow, a marker such as an arrow pointing 
the prospective abnormal shadow in the overall image or a 
rectangular, a circular ROI frame circumscribing the 
25 prospective abnormal shadow, or a line extending along the edge 
of the prospective abnormal shadow may be used. The malignant 
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prospective abnormal shadow and the benignant prospective 
abnormal shadow may be marked with a marker, ROI frame or the 
like which are different in color and/or shape. With this 
arrangement, malignant and benignant prospective abnormal 
5 shadows can be distinguished from each other even they are 
output simultaneously. 

It is preferred that the prospective abnormal shadow 
information output means outputs an index of the malignancy 
and/or an index of the benignancy of the prospective abnormal 
"^10 shadow. 

Though it is preferred that the index be output near the 
'f* image of the prospective abnormal shadow, the marker, ROI frame 

or the like simultaneously therewith, the index may be 
L; separately output from the image of the prospective abnormal 

-15 shadow, the marker, ROI frame or the like. 
JT The ind ex of the malignancy and/or the benignancy of the 

H= prospective abnormal shadow need not directly indicate the 

malignancy and/or the benignancy of the prospective abnormal 
shadow but may be any index so long as it can directly or 
2 0 indirectly indicate the malignancy and/or the benignancy of 
the prospective abnormal shadow. For example, the feature 
value of image information such as the degree of convergence 
of the growth shadows, the output value of the iris filter or 
the morphology filter, and the density of the calcification, 
25 the threshold value on the basis of which the prospective 
abnormal shadow detecting means detects a prospective abnormal 



shadow, or the "confidence of detection of the prospective 
abnormal shadow" may be employed as the index of the malignancy 
and/or the benignancy of the prospective abnormal shadow. 

The "confidence of detection of the prospective abnormal 
5 shadow" is, for instance, the margin by which the feature value 
of the part which has been determined to be a prospective 
abnormal shadow exceeds the threshold value in the case where 
the prospective abnormal shadow detecting means determines a 
part to be a prospective abnormal shadow when the feature value 
£ 2 10 of the P art exceeds a predetermined threshold value. 

With the prospective abnormal shadow detecting system 
f=J of this invention, the reader or the doctor can know to some 
=H extent which of the prospective abnormal shadows is malignant 

L-. and accordingly, the diagnostic efficiency can be improved. 

p3l5 Further, output of an index of the malignancy and/or the 

H= benignancy of the prospective abnormal shadow greatly assists 
the reader or the doctor in reading the radiation image. 

In a preferred embodiment of the present invention, the 
malignancy judging means judges whether the prospective 
2 0 abnormal shadow detected by the prospective abnormal shadow 
detecting means is malignant or benignant by 

obtaining a benignancy evaluation function value which 
is a value of an evaluation function for benignancy, a 
malignancy evaluation function value which is a value of an 
25 evaluation function for malignancy, and a normalcy evaluation 
function value which is a value of an evaluation function for 



9 



normalcy by defining feature values of the image data by a 
predetermined function, and 

comparing the normalcy evaluation function value with 
the benignancy evaluation function value and the normalcy 
5 evaluation function value with the malignancy evaluation 
function value. 

The predetermined function may be any function so long 
as it depends upon benignancy or malignancy of the prospective 
abnormal shadow. For example, when at least two (n in number) 

10 of lots of feature values obtained in the prospective abnormal 
shadow detecting processing are plotted on n - dimensional 
feature axes (xl, x2 , x3 , •", xn) to express the prospective 
abnormal shadow in an n - dimensional pattern space, and a 
function representing a concept of distance taking into 

15 account spread of shadow patterns is employed as the 
predetermined function in the n-dimensional pattern space, 
whether the shadow is malignant or benignant can be known. As 
the function representing a concept of distance, a Mahalanobis 
distance, a city block distance, a chess-board distance, a 

2 0 Minkowski distance or the like may be employed. 

Whether the shadow is benignant or malignant may be 
judged in any manner so long as the malignancy and benignancy 
are distinguished from each other on the basis of comparison 
of the evaluation function values. For example, the 

25 prospective abnormal shadows may be divided only into 
malignancy and benignancy or may be divided into normalcy, 
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malignancy and benignancy. 

For example, first and second likelihood ratios LR1 and 
LR2 which are respectively defined to be LRl=normalcy 
evaluation function/malignancy evaluation function and LR2= 
5 normalcy evaluation f unction/benignancy evaluation function 
are first obtained. Then it is determined that the prospective 
abnormal shadow is malignant when the first likelihood ratio 
LRl>the second likelihood ratio LR2 and at the same time, the 
first likelihood ratio LR1 >a first threshold value, and that 

10 prospective abnormal shadow is benignant when the first 
likelihood ratio LRKthe second likelihood ratio LR2 and at 
the same time, the second likelihood ratio LR2 >a second 
threshold value, and otherwise it determined that the 
prospective abnormal shadow is a shadow of a normal part. 

15 Further it may be determined that that the prospective 

abnormal shadow is malignant when the first likelihood ratio 
LRl>the second likelihood ratio LR2 and at the same time, the 
first likelihood ratio LR1 >a first threshold value while it 
is otherwise determined that the prospective abnormal shadow 

2 0 is benignant. 

It is preferred that the Mahalanobis distance from a 
normal tissue distribution be employed as the normalcy 
evaluation function value, the Mahalanobis distance from a 
benignant tissue distribution be employed as the benignancy 

25 evaluation function value, and the Mahalanobis distance from 
a malignant tissue distribution be employed as the malignancy 
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evaluation function value. 

In this case, the first likelihood ratio LR1 is the 
Mahalanobis distance from a normal tissue distribution/the 
Mahalanobis distance from a malignant tissue distribution, and 
5 the second likelihood ratio LR2 is the Mahalanobis distance 
from a normal tissue distribution/ the Mahalanobis distance 
from a benignant tissue distribution. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a schematic block diagram showing a 
10 prospective abnormal shadow detecting system in accordance 
with an embodiment of the present invention. 

Figure 2 is a flow chart for illustrating the prospective 
abnormal shadow detecting processing and the malignancy- 
judging processing to be executed by the prospective abnormal 
15 shadow detecting system, 

Figure 3A is an example of a mammogram to which the 
present invention is applied, 

Figures 3B to 3D are views for illustrating the degree 
of convergence of density gradient vectors in the mammogram, 
20 Figure 4 is a view showing a mask for calculating gradient 

vectors in the iris filter processing, 

Figure 5 is a view for illustrating the degree of 
convergence of gradient vectors for the pixel of current 
interest, 

25 Figure 6 is a view for illustrating an iris filter whose 

size and shape are changed to conform to the size and shape 
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of the growth, 

Figure 7 is a view for illustrating formation of the IFED 

image, 

Figure 8 is a schematic view showing an IFED image, 
5 Figure 9 is a view for illustrating formation of the 

simultaneous matrix on the basis of the IFED image, 

Figure 10 is a schematic view showing a simultaneous 
matrix. 

Figure 11A is a conceptional view showing the relation 

10 between the first likelihood ratio LR1 and the Mahalanobis 
distance Dml from the normal tissue distribution and the 
Mahalanobis distance Dm2 from the cancer distribution. 

Figure 11B is a conceptional view showing the relation 
between the second likelihood ratio LR2 and the Mahalanobis 

15 distance Dml from the normal tissue distribution and the 
Mahalanobis distance Dm3 from the benignant distribution, 

Figure 11C is a conceptional three-dimensional view 
showing the relation between the first likelihood ratio LR1 
and the Mahalanobis distance Dml from the normal tissue 

20 distribution and the Mahalanobis distance Dm2 from the cancer 
distribution and the relation between the second likelihood 
ratio LR2 and the Mahalanobis distance Dml from the normal 
tissue distribution and the Mahalanobis distance Dm3 from the 
benignant distribution, 

25 Figure 12A is a view showing a frame displayed by the 

prospective abnormal shadow detecting system, and 
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Figure 12B is a view showing a part of the frame in Figure 
12A in an enlarged scale. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 
In Figure 1, a prospective abnormal shadow detecting 
5 system 1 in accordance with an embodiment of the present 
invention receives a mammogram P of a patient and outputs image 
information and the like to an image output means 30, which 
may be, for instance, a CRT or a liquid crystal panel. The 
prospective abnormal shadow detecting system 1 comprises a 

10 prospective abnormal shadow detecting means 10 which detects 
a prospective abnormal shadow PI in "the overall image" (the 
mammogram) P on the basis of image data P (also the image data 
on the mammogram P is sometimes indicated at P) , a malignancy 
judging section 50 which judges whether the prospective 

15 abnormal shadow PI detected by the prospective abnormal shadow 
= detecting means 10 is malignant or benignant on the basis of 
a predetermined feature value, an interest area setting means 
20 which sets a square area circumscribing the prospective 
abnormal shadow PI as an interest area, an image processing 

20 means 40 which carries out enlargement/contraction processing 
and/or frequency enhancement processing on the image W0 of the 
interest area to obtain a processed interest area image W, and 
an image output means 3 0 which displays, together with the 
overall image P, the processed interest area image W as 

2 5 information on the prospective abnormal shadow PI detected by 
the prospective abnormal shadow detecting means 1 and indexes 
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K representing, for instance, a threshold value on the basis 
of which the prospective abnormal shadow detecting means 1 
determines whether a part of the overall image P bears a 
prospective abnormal shadow. 
5 The image output means 30 outputs the information on the 

prospective abnormal shadow PI so that whether the prospective 
abnormal shadow PI is malignant or benignant is 
distinguishable . 

The prospective abnormal shadow detecting means 10 

10 stores both an algorism for detecting a prospective growth 
shadow by the use of an iris filter and an algorism for detecting 
a prospective calcification shadow by the use of a morphology 
filter, and detects the shape, position, size and number of 
the prospective abnormal shadows detected by the respective 

15 algorisms. In the algorism for detecting a prospective growth 
shadow by the use of an iris filter, parts where the degree 
of convergence of density gradients is higher are taken as 
prospective growth shadows and in the algorism for detecting 
a prospective calcification shadow by the use of a morphology 

20 filter, parts where density fluctuates in a space narrower than 
multiple structural elements are taken as prospective 
calcification shadow. The prospective abnormal shadows 
detected by the respective algorisms are different in nature, 
that is, the former being a prospective growth shadow and the 

25 former being a prospective calcification shadow. 

Further, the prospective abnormal shadow detecting 
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means 1 outputs, to the image output means 30, the threshold 
value of the degree of convergence of density gradients and 
the output I of the iris filter on the basis of which the 
prospective abnormal shadow detecting means 1 determines 
5 whether the part is a prospective growth shadow, feature values 
such as the density of calcification of the part on the basis 
of which the prospective abnormal shadow detecting means 10 
determines whether the part is a prospective calcification 
shadow, indexes derived from the feature values and the 

10 "confidence of detection of the prospective abnormal shadow", 
e.g. , the amount by which the feature value of the part which 
has been determined to be a prospective abnormal shadow exceeds 
the threshold value. 

The malignancy judging section 50 determines the value 

15 of index of the malignancy or the benignancy of the prospective 
abnormal shadow (the prospective growth shadow or the 
prospective calcification shadow) and outputs it to the image 
output means 30. 

As shown in Figure 1, the malignancy judging section 50 

20 comprises an evaluation function value calculating means 51 
which defines a feature value of the image information by a 
predetermined weight function and calculates a value of a 
benignancy evaluation function representing the benignancy, 
a value of a malignancy evaluation function representing the 

25 malignancy and a value of a normalcy evaluation function 
representing the normalcy. The malignancy judging section 50 
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further comprises a judging means 53 which judges whether the 
prospective abnormal shadow is malignant or benignant by- 
comparing the value of the normalcy evaluation function with 
the value of the benignancy evaluation function and the value 
5 of the normalcy evaluation function with the value of the 
malignancy evaluation function. 

Specifically, the evaluation function value calculating 
means 51 calculates the Mahalanobis distance from a normal 
tissue distribution as the value of the normalcy evaluation 
10 function, the Mahalanobis distance from a benignant tissue 
distribution as the value of the benignancy evaluation 
function, and the Mahalanobis distance from a malignant tissue 
distribution as the value of the malignancy evaluation 
function. 

15 The judging means 53 calculates a first likelihood ratio 

(=the value of the normalcy evaluation function/the value of 
the malignancy evaluation function) and a second likelihood 
ratio (=the value of the normalcy evaluation function/the 
value of the benignancy evaluation function) , and judges 

2 0 whether the prospective abnormal shadow is malignant or 
benignant through comparison of the first and second 
likelihood ratios with a predetermined threshold value. 

Operation of the prospective abnormal shadow detecting 
system 1 of this embodiment will be described hereinbelow. 

25 The overall image information P of a mammogram is input 

into the prospective abnormal shadow detecting means 1 from 
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an external image forming modality (e.g., CT or CR) . The 
prospective abnormal shadow detecting means 1 carries out 
prospective abnormal shadow detecting processing on the 
overall image information P according to an algorism for 
5 detecting a prospective growth shadow by the use of an iris 
filter and an algorism for detecting a prospective 
calcification shadow by the use of a morphology filter. 

Detection of a prospective growth shadow by the use of 
an iris filter (the iris filter processing) and the malignancy 
10 judging processing (judgment whether the prospective growth 
shadow detected by the iris filter processing is malignant or 
benignant) will be described hereinbelow. 

In this particular embodiment, image data is a high 
density, high level signal which is used, for instance, when 
15 a radiation image is recorded on a photographic film and in 
which as the value of density increases, the level of the signal 
becomes higher. 

Figure 2 shows a flow chart for illustrating a specific 
procedure of the iris filter processing and the malignancy 
20 judging processing. 

The iris filter processing is carried out on densities 
S of the image data representing a radiation image of the breast 
P (Figure 3A) input from the external modality to detect a 
prospective growth (e.g., breast cancer) shadow PI. 
2 5 Iris filter processing 

(step Al in Figure 2) : calculation of the gradient vectors 
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Calculation represented by the following formula (1) is 
effected for each of the pixels j of the radiation image and 
the orientation 0 of the density gradient vector of image data 
S is obtained. 



wherein f t to fi S are, as shown in Figure 4, values (image data) 
of pixels on the outer periphery of a 5X5 pixel mask about 
a given pixel j (pixel of current interest) . Needless to say, 
the size of the mask need not be limited to 5X5. 

10 (step A2) : calculation of the degree of convergence of the 
gradient vectors 

After the orientations 6 of the density gradient vector 
for all the pixels are calculated, a pixel onto which the 
orientations 6 of the density gradient vector are converged 

15 is detected. That is, the degree of convergence C of the 
gradient vectors onto each of the pixels j of the image is 
calculated according to the following formula (2) . 

C = (l/iV)£cos6> ; (2) 

7=1 

wherein N represents the number of pixels in a circle with its 
20 center at a pixel of current interest and with a radius of R 
and 8 j represents the angle between the straight line 
connecting the pixel of current interest and each of the pixels 
j in the circle and the gradient vector for the pixel j as 
calculated according to the aforesaid formula (1) as shown in 
25 Figure 5. Accordingly, the degree of convergence C as 
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calculated according the aforesaid formula (2) becomes high 
when many of the orientations 6 j of the gradient vectors for 
the pixels j are directed toward the pixel of current interest. 
It has been known that in a negative radiation image, 
5 a growth shadow is generally lower in density (higher in 
brightness) at a central portion thereof than surroundings, 
and the density distribution in the growth shadow is such that 
the density is lower at the central portion and is gradually 
increased toward the periphery thereof. Accordingly, taking 

LO into account the degree of convergence C of the gradient vectors, 
growth shadows PI (Figure 3B) can be distinguished from shadows 
P2 of blood vessels or mammary glands (Figure 3C) . 
(step A2) :processing of improving adaptability to shape and 
detecting accuracy of the filter 

L5 The size and shape of the filter are changed to conform 

to the size and shape of the growth so that growth can be 
detected without affected by the size and shape of the growth. 
Figure 6 shows an example of such a filter. In the filter shown 
in Figure 6, the degree of convergence C is evaluated on the 

20 basis of only pixels on radial lines extending from the pixel 
of current interest in M directions at regular intervals of 
2 7C/M (in the example shown in Figure 6, in 32 directions at 
regular intervals of 11.25° ). 

The coordinates ( [x] , [y] ) of a pixel which is in an i - th 

25 direction (on an i - th radial line) and an n- th pixel as numbered 
from the pixel of current interest are given by the following 
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formulae (3) and (4) wherein (k, 1) are the coordinates of the 
pixel of current interest, and [x] and [y] are maximum integers 
which are not larger than x and y, respectively. 
x = k+n cos {2 71 (i -1) /M} (3) 
5 x = l+n sin{2 71 (i -1) /M} (4) 

The value of outputs of the pixels from the pixel of 
current interest to the pixel at which the degree of convergence 
C is maximized on each of the 32 directions is taken as the 
degree of convergence C imax in the direction, and the degrees 
,10 of convergence C iniax in all the directions are averaged. The 
average of the degrees of convergence C iinax in all the directions 
thus obtained is taken as the degree of convergence C of the 
gradient vectors for the pixel of current interest. 

Specifically, the degrees of convergence Ci( n ) are 
15 calculated for pixels in the range of from a pixel of current 
interest to a pixel which is in an i - th direction (on an i-th 
radial line) and an n-th pixel as numbered from the pixel of 
current interest is calculated according to the following 
formula (5) . 

20 ^^^{(cos^J/nJ^^n^iCx (5) 

That is, formula (5) is for calculating the degrees of 
convergence C i(n) for the pixels in the range of from the pixel 
of current interest to a pixel which is between the R m i n - th pixel 
and the R max -th pixel as numbered from the pixel of current 
25 interest on each radial line, the values of R min and R max 
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respectively corresponding to a minimum radius and a maximum 

radius of a growth shadow to be extracted. 

Then the degrees of convergence C of the gradient vectors 

are calculated according to the following formulae (6) and (7) . 

C jm . Y = max Ci(n) 
5 ,max V J (6) 

C = (l/32)fc imax ( 7 ) 

Since the C imax obtained from f ormula (6) is the maximum 
value of the degrees of convergence C i(n ) in each direction 
obtained according to formula (5) , the area between the pixel 

10 of current interest and the pixel at which the degree of 
convergence C i(n ) is maximized is a prospective growth shadow 
area in the direction. 

By obtaining prospective growth shadow areas in all the 
directions according to formula (6) and connecting the 

15 prospective growth shadow areas in adjacent directions by a 
linear line or non-linear line, the outer shape of the overall 
prospective growth shadow area can be determined. 

In formula (7) , the maximum values C± max of the degrees 
of convergence C i(n ) for the respective directions are averaged. 

2 0 By comparing the average of the maximum values Ci max of the 
degrees of convergence C i(n) with a threshold value T, whether 
the area having its center at the pixel of current interest 
is a prospective growth shadow (a prospective abnormal shadow) 
is determined. 
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Since the area over which the degrees of convergence C 
of the gradient vectors varies in its size and shape according 
to the gradient vector distribution in a similar manner to that 
in which the human iris is enlarged and contracted according 
5 to the ambient brightness, the method of detecting a 
prospective growth shadow using the degree of convergence of 
gradient vectors is called "iris filter processing". 

The degree of convergence C i(n) may be calculated 
according to the following formula (5') in place of the 
10 aforesaid formula (5) . 

C 'W" 1 Z COS ^^n^^ax <5'> 

n ~ *Wi 

That is, formula (5') is for calculating the degrees of 
convergence Ci( n ) for the pixels in the range of from the R m in-th 
pixel to a pixel which is between the R m j. n - th pixel and the R max - th 

15 pixel as numbered from the pixel of current interest on each 
radial line, the values of R min and R max respectively 
corresponding to a minimum radius and a maximum radius of a 
growth shadow to be extracted. 
Malignancy judging processing 

20 According to the iris filter processing, growth shadows 

of a desired size can be basically effectively extracted. 
However, for instance, a part P3 where two blood vessels 
intersect each other as shown in Figure 3D, the degree C of 
convergence also takes a large value, which makes it difficult 

25 to clearly separate the growth shadow PI from such a part P3 
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(will be referred to as "pseudo - abnormal - shadow" , 
hereinbelow) . 

Further, even if prospective abnormal shadows can be 
separated from normal shadows, whether the prospective 
5 abnormal shadows are malignant or benignant cannot be judged 
by the iris filter processing. This is the case also with 
detection of calcification by the morphology filter. 

In this particular embodiment, the malignancy judging 
section 50 determines whether the prospective abnormal shadow 
M10 as detected by the prospective abnormal shadow detecting means 
^ 1 is malignant or benignant by the use of the a Mahalanobis 

distance in the manner shown in steps Bl to B8 in Figure 2. 
=P (step Bl) 

!L Iri step Bl, square areas including the respective 

£015 prospective abnormal shadows detected by the iris filter 
M= processing (can include a pseudo - abnormal - shadow) and their 

M vicinities are extracted. 

In step B2, an edge image is prepared for each of the 
extracted square area in the following manner. 
20 A point at which the degrees of convergence C i{n) is 

maximized on each radial line is obtained over the entire length 
thereof. Though, in the aforesaid formulae (5) or (5') and 
(6) , the value on n is limited in the range from R min to R max , 
the point at which the degrees of convergence C i(n ) is maximized 
25 is obtained over the entire length thereof without the value 
of n limited in the range from R min to R max in this step. 
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As a result, when the pixel of current interest is inside 
the prospective abnormal shadow (PI or P3 ) , the value of n which 
gives the point at which the degrees of convergence Ci (n) is 
maximized on the i - th radial line indicates the pixel (s) at 
5 which the i - th line intersects the edge of the prospective 
abnormal shadow B (Figure 7) . For example, for a pixel of 
current interest 1, the value of n indicates pixels Bl, B2 , 
B3 and B4 , and for a pixel of current interest 2, the value 
of n indicates pixels B2 , B5 , B6 and B7 . 

10 To the contrast, when the pixel of current interest is 

outside the prospective abnormal shadow (PI or P3) , the value 
of n which gives the point at which the degrees of convergence 
Ci( n ) is maximized on the i - th radial line indicates the pixel 
of current interest itself (e.g., pixel of current interest 

15 3 in Figure 7) . 

With all the pixels in the extracted area taken as the 
pixel of current interest in sequence, the frequency at which 
each pixel becomes the point of maximum convergence (the point 
at which the degrees of convergence C i{n ) is maximized) is 

2 0 counted. 

The counts for the pixels outside the prospective 
abnormal shadow are all "1", the counts for the pixels inside 
the prospective abnormal shadow are all "0" and the counts for 
the pixels on the edge of the prospective abnormal shadow are 
25 all larger than 1 as shown in Figure 8. The image representing 
the values of the count for the pixels in the extracted area 
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is defined to be an IFED (Iris Filter Edge) image. 

In step B3, the IFED image is processed in the following 
manner . 

As shown in Figure 9, the center of gravity AO of the 
prospective abnormal shadow (PI or P3) is obtained and a radial 
line is extended from the center of gravity AO. Then a given 
point on the radial line is taken as point i^ and a point which 
is on a line perpendicular to the radial line and is at a 
distance of two pixels from the point i_ is taken as point j . 

The frequency at which the relation between the counts 
for pixel jl and pixel j_ becomes a certain relation (e.g. , [i = 0, 

j=0], [i=l, j = 0], [i=l, j=l] ) is counted up in a matrix 

such as shown in Figure 10. For example, when the count for 
pixel i is 1 and the count for pixel j is 1, that is, both pixels 
i and j_ are outside the prospective abnormal shadow PI or P3, 
1 is written in the cell (1, 1) where i=l and j=l. When the 
count for pixel i is 0 and the count for pixel j_ is 0, that 
is, both pixels _i and j_ are inside the prospective abnormal 
shadow PI or P3, 1 is written in the cell (0, 0) where i = 0 and 
j=0. When the count for pixel _i is 5 and the count for pixel 
j_ is 3, that is, both pixels i and j_ are on the edge of the 
prospective abnormal shadow PI or P3, 1 is written in the cell 
(5, 3) where i=5 and j=3. 

The radial line is rotated and the pixel i is changed 
so that all the pixels in the IFED image becomes the pixel i, 
and the value in each cell is incremented each time the relation 
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between the counts for the pixel i. and the pixel j_ becomes that 
represented by the cell. For example, when the relation where 
the count for pixel i is 5 and the count for pixel j is 3 appears 
twice, then the count in the cell (5, 3) is 2. In this manner, 
5 the simultaneous matrix shown in Figure 10 is completed. 

Since the growth shadow is generally circular in shape 
and the points i^ and j_ are very close to each other, when the 
points i and j are both on the edge of the prospective abnormal 
shadow, that is, the IFEFD image counts for the pixels i. and 

10 j_ are both larger than 1, there is a strong possibility that 
the prospective abnormal shadow as detected by the iris filter 
processing is a real growth shadow PI. 

To the contrast, since a pseudo - abnormal - shadow P3 is 
rarely circular in shape, there is very weak possibility that 

15 the points i and j are both on the edge of the prospective 
abnormal shadow, that is, the IFEFD image counts for the pixels 
i. and j_ are both larger than 1, when the prospective abnormal 
shadow as detected by the iris filter processing is a 
pseudo - abnormal shadow P3 . 

2 0 Accordingly, feature values of the simultaneous matrix 

(x, y) have significant differences between when the 
prospective abnormal shadow as detected by the iris filter 
processing is a real growth shadow PI and when it is merely 
a pseudo -abnormal -shadow P3 . The feature values of the 

2 5 simultaneous matrix are edge information. 

In step B4, as the specific terms of the edge information, 
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feature values of the simultaneous matrix, i.e., a first index 
var representing dispersion (the following formula (8)), a 
second index df e representing difference entropy (the 
following formula (9) ) , a third index cor representing 
correlation (the following formula (10)), a fourth index idm 
representing inverse difference moment (the following formula 
(11) ) , and a fifth index se representing sum entropy (the 
following formula (12)) are calculated. 



var 



=Elfe-"J^(u)} 
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j 

P x (i) is the projection distribution in j_ direction, 

^(O-Z^fc^). and 

j 

P y (j) is the projection distribution in 1_ direction, 

The first to third indexes var, dfe and cor take a 
D relatively large value when the prospective abnormal shadow 

y3 is a real growth shadow PI and take a relatively small value 
W when the prospective abnormal shadow is a 

«RLO pseudo - abnormal - shadow P3 such as a shadow of a mammary gland 
s_ or a blood vessel. 

M The fourth index takes a relatively small value when the 

H= prospective abnormal shadow is a real growth shadow PI and takes 
M= a relatively large value when the prospective abnormal shadow 
15 is a pseudo-abnormal -shadow P3 such as a shadow of a mammary 
gland or a blood vessel. The fifth index takes a relatively 
large value when the prospective abnormal shadow is a real 
growth shadow PI and takes a relatively small value when the 
prospective abnormal shadow is a pseudo - abnormal - shadow P3 
20 such as a shadow of a mammary gland or a blood vessel. 

Thereafter, the feature values are defined as an 
evaluation function by a predetermined weight function and 
malignancy/benignancy of the prospective abnormal shadow is 
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judged on the basis of the evaluation function. 

As disclosed, for instance, in Japanese Unexamined 
Patent Publication No . 9 (1997 )- 167238 , a Mahalanobis distance, 
a Fisher' s discrimination function and the like can be employed 
5 as the evaluation function defined by a weight function. In 
this particular embodiment, the Mahalanobis distance is 
employed . 

In step B5, the values of the five indexes are plotted 
on different f ive - dimensional axes (var=xl, dfe=x2, cor=x3, 

10 idm=x4 and se=x5) and a vector x consisting of the 
five-dimensional elements is set. 

In step B6, the Mahalanobis distance of the prospective 
abnormal shadow from a pattern of a normal shadow (the 
Mahalanobis distance from a normal tissue distribution) Dml , 

15 the Mahalanobis distance from a pattern of a malignant tissue 
distribution (the Mahalanobis distance from a cancer 
distribution in an abnormal shadow) Dm2 , and the Mahalanobis 
distance from a pattern of a benignant tissue distribution (the 
Mahalanobis distance from a benignancy distribution in an 

2 0 abnormal shadow) Dm3 are calculated according to the following 
formula (13). The steps Bl to B6 are executed by the evaluation 
function value calculating means 51. 

Dnu-(-T+— (13) 
wherein represents a covariance matrix of a pattern class 

25 wi (of normal shadows where i=l, of malignant shadows where 
i=2 and of benignant shadows where i=3) , that is, 
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wherein t represents a transposed vector (a transverse vector) , 
— — > represents a feature value x in vector (that is, 
— — >= (xl, x2 , ••• , xN) , represents an inverse matrix of 

5 , and — ^t— > represents the average of the pattern class wi 

(that is, -—^ = (l/Niy£—ir>). 

The pattern classes of normal shadows, malignant shadows 
and benignant shadows are pattern spaces defined by vector x 
which have been set respectively for normal shadows, malignant 

10 shadows (the cancer part shadow in the abnormal tissue 
distribution) and benignant shadows (the benignant part shadow 
in the abnormal tissue distribution) on the basis of the result 
of investigation on a lot of prospective abnormal shadows . For 
example, the pattern class wl of normal shadows is defined by 

15 the average of the vectors x of normal shadows, the pattern 
class w2 of malignant shadows is defined by the average of the 
vectors x of malignant shadows, and the pattern class w3 of 
benignant shadows is defined by the average of the vectors x 
of benignant shadows. 

20 After, the Mahalanobis distance Dml between the pattern 

of the prospective abnormal shadow as detected by the iris 
filter processing and the normal shadow pattern, the 
Mahalanobis distance Dm2 between the pattern f the prospective 
abnormal shadow and the malignant shadow pattern, and the 
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Mahalanobis distance Dm3 between the pattern f the prospective 
abnormal shadow and the benignant shadow pattern, the judging 
means 53 compares the Mahalanobis distance Dml between the 
pattern of the prospective abnormal shadow as detected by the 
5 iris filter processing and the normal shadow pattern with the 
Mahalanobis distance Dm2 between the pattern of the 
prospective abnormal shadow and the malignant shadow pattern 
and with the Mahalanobis distance Dm3 between the pattern of 
the prospective abnormal shadow and the benignant shadow 
10 pattern. 

In this comparison, first and second likelihood ratios 
LR1 and LR2 defined by the following formulae (14) and (15) 
are employed. 

LR1 =Dml/Dm2 (14) 
15 LR2=Dml/Dm3 (15) 

The first likelihood ratio LR1 may be weighted as shown 
in the following formula (16) . 

LR1 = Dm\/Dm2*Wl*W2 (16) 

wherein Wl may be a coefficient based on the difference between 
20 the right and left breasts and W2 may be a coefficient based 
on the age or the position of the prospective abnormal shadow. 

Figure 11A is a conceptional view showing the relation 
between the first likelihood ratio LR1 and the Mahalanobis 
distance Dml from the normal tissue distribution and the 
25 Mahalanobis distance Dm2 from the cancer distribution, Figure 
11B is a conceptional view showing the relation between the 
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second likelihood ratio LR2 and the Mahalanobis distance Dml 
from the normal tissue distribution and the Mahalanobis 
distance Dm3 from the benignant distribution, and Figure 11C 
is a conceptional three-dimensional view showing the relation 
5 between the first likelihood ratio LR1 and the Mahalanobis 
distance Dml from the normal tissue distribution and the 
Mahalanobis distance Dm2 from the cancer distribution and the 
relation between the second likelihood ratio LR2 and the 
Mahalanobis distance Dml from the normal tissue distribution 
-^-10 and the Mahalanobis distance Dm3 from the benignant 
• distribution. In Figures 11A to 11C, the inclination of the 

straight line represents the likelihood ratio. 

When the prospective abnormal shadow as detected by the 
'~Z iris filter processing is a shadow of real malignant growth, 
15 the Mahalanobis distance Dm2 from the cancer distribution is 
small and the Mahalanobis distance Dml from the normal tissue 
distribution is large. That is, when the prospective abnormal 
shadow as detected by the iris filter processing is a shadow 
of real malignant growth, the line representing the relation 
20 between the first likelihood ratio LR1 and the Mahalanobis 
distance Dml from the normal tissue distribution and the 
Mahalanobis distance Dm2 from the cancer distribution 
generally appears on the left upper side of line al which is 
large in inclination (e.g., about 10) as shown in Figure 11A. 
25 To the contrast, when the prospective abnormal shadow as 
detected by the iris filter processing is not a shadow of real 
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malignant growth but a shadow of a normal tissue mistaken for 
an abnormal shadow, the line representing the relation between 
the first likelihood ratio LR1 and the Mahalanobis distance 
Dml from the normal tissue distribution and the Mahalanobis 
5 distance Dm2 from the cancer distribution generally appears 
on the right lower side of line a2 which is small in inclination 
(e.g., about 0.1) as shown in Figure 11A. 

Similarly, when the prospective abnormal shadow as 
detected by the iris filter processing is a shadow of real 
OlO benignant growth, the Mahalanobis distance Dm3 from the 
%Q benignant distribution is small and the Mahalanobis distance 

W Dml from the normal tissue distribution is large. That is, 

»p when the prospective abnormal shadow as detected by the iris 

s_ filter processing is a shadow of real benignant growth, the 

£-315 line representing the relation between the first likelihood 
M= ratio LR1 and the Mahalanobis distance Dml from the normal 

M= tissue distribution and the Mahalanobis distance Dm3 from the 

benignant distribution generally appears on the left upper 
side of line bl which is large in inclination (e.g., about 10) 
20 as shown in Figure 11B. To the contrast, when the prospective 
abnormal shadow as detected by the iris filter processing is 
not a shadow of real growth but a shadow of a normal tissue 
mistaken for an abnormal shadow, the line representing the 
relation between the second likelihood ratio LR2 and the 
25 Mahalanobis distance Dml from the normal tissue distribution 
and the Mahalanobis distance Dm3 from the benignant 
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distribution generally appears on the right lower side of line 
b2 which is small in inclination (e.g., about 0.1) as shown 
in Figure 11B. 

When the prospective abnormal shadow as detected by the 

5 iris filter processing is a shadow of malignant growth, the 
Mahalanobis distance Dm2 from the malignant distribution is 
smaller than the Mahalanobis distance Dm3 from the benignant 
distribution. To the contrast, when the prospective abnormal 
shadow as detected by the iris filter processing is a shadow 

0 of benignant growth, the Mahalanobis distance Dm3 from the 
benignant distribution is smaller than the Mahalanobis 
distance Dm2 from the malignant distribution. Accordingly, 
whether the prospective abnormal shadow as detected by the iris 
filter processing is a shadow of malignant growth or a shadow 

5 of benignant growth can be discriminated by comparing the 
Mahalanobis distance Dm2 from the malignant distribution and 
the Mahalanobis distance Dm3 from the benignant distribution. 
That is, when the first likelihood ratio LR1 is larger than 
the second likelihood ratio LR2 , the probability that the 

0 prospective abnormal shadow as detected by the iris filter 
processing is a shadow of malignant growth is stronger than 
the probability that the prospective abnormal shadow as 
detected by the iris filter processing is a shadow of benignant 
growth, and when the first likelihood ratio LR1 is smaller than 

5 the second likelihood ratio LR2 , the probability that the 
prospective abnormal shadow as detected by the iris filter 
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processing is a shadow of benignant growth is stronger than 
the probability that the prospective abnormal shadow as 
detected by the iris filter processing is a shadow of malignant 
growth. This means in Figure 11C that the parts having a 
5 stronger probability that it is an abnormal shadow 
concentrates on an area near to axis Dml , and when the area 
is projected onto Dm2-Dm3 plane, the malignant parts are 
positioned on the right lower side of line c whose inclination 
is 1.0 and the benignant parts are positioned on the left upper 

10 side of the line c. 

On the basis of the fact described above, in step B8, 
it is determined that the prospective abnormal shadow as 
detected by the iris filter processing is malignant when the 
first likelihood ratio LR1 is larger than the second likelihood 

,%L5 ratio LH2 and at the same time the first likelihood ratio LR1 
is larger than a first threshold value Thl which corresponds 
to the inclination of line al, and it is determined that the 
prospective abnormal shadow as detected by the iris filter 
processing is benignant when the first likelihood ratio LR1 

20 is smaller than the second likelihood ratio LH2 and at the same 
time the second likelihood ratio LR2 is larger than a second 
threshold value Th2 which corresponds to the inclination of 
line bl. Otherwise, it is determined that the prospective 
abnormal shadow as detected by the iris filter processing is 

25 a shadow of a normal tissue. 

In this manner, the growth shadow PI which cannot be 
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distinguished from the pseudo - abnormal - shadow P3 only by the 
iris filter processing can be distinguished from the 
pseudo - abnormal - shadow P3 and at the same time, whether the 
prospective abnormal shadow as detected by the iris filter 
5 processing is malignant or benignant can be distinguished. 

As can be seen from the description above, the larger 
the first likelihood ratio LR1 is, the stronger the probability 
that the prospective abnormal shadow is malignant. 
Accordingly, the first likelihood ratio LR1 can be a malignancy 
LO evaluation function. Similarly, the larger the second 
likelihood ratio LR2 is, the stronger the probability that the 
prospective abnormal shadow is benignant. Accordingly, the 
second likelihood ratio LR2 can be a benignancy evaluation 
function . 

,15 The judging means 53 of the malignancy judging section 

50 takes, as indexes K, the feature values obtained in the 
prospective abnormal shadow detecting processing (e.g., the 
degree of convergence of gradient vectors, the output value 
I of the iris filter or the morphology filter, and the like) 

2 0 for the parts or the areas of the mammogram other than those 
determined to be normal in step B8, and calculates the margins 
of the indexes K against the respective threshold values T (e.g., 
K/T, 100X (K-T) /K %, and K-T) . Then the judging means 53 inputs 
the indexes K and their margins into the image output means 

25 30 . 

The prospective abnormal shadows PI which are still taken 
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as prospective abnormal shadows after the malignancy judging 
processing are input into the interest area setting means 20. 
The interest area setting means 20 sets areas of a predetermined 
shape (e.g., a circle or a square) including therein one of 

5 the prospective abnormal shadows as interest areas. 

The interest area setting means 20 inputs image 
information WO and coordinate information Wl on the interest 
areas into the image processing means 40 . The image processing 
means 40carries out desired processing, e.g., enlargement 

0 processing or frequency enhancement processing, on the image 
information WO on the interest areas and obtains processed 
interest area image information W. Then the image processing 
means 40 inputs the processed interest area image information 
W into the image output means 3 0 as the prospective abnormal 

5 shadow. 

Into the image output means 30, the overall image data 
P on the basis of which the interest areas are set, and the 
indexes K and their margins for the prospective abnormal shadow 
PI are also input, and the image output means 3 0 displays the 

0 overall image P, the processed interest area image W, the 
indexes K and their margins in one frame as shown in Figures 
12 A and 12B. The image output means 3 0 displays ROI frames, 
representing the positions and the sizes of the interest areas, 
on the overall image P in different colors by the malignancy 

5 or the benignancy of the prospective abnormal shadows. Though, 
in Figure 12A, mammograms P and P' of the left and right breasts 
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are displayed back to back in one frame, the layout of the frame 
need not be limited to such a layout. For example, mammograms 
of the left and right breasts may be displayed alternately. 

Further, malignant prospective abnormal shadows may be 
5 marked with, for instance, red arrows with benignant 
prospective abnormal shadows marked with, for instance, blue 
arrows while the malignancy and/or the benignancy for the 
respective prospective abnormal shadows are displayed 
together with the prospective abnormal shadows. 
*S-0 In the prospective abnormal shadow detecting system 1 

of this embodiment, pseudo - abnormal - shadows P3 which cannot 
7!\ be distinguished from a real prospective abnormal shadow PI 

by the iris filter processing only can be distinguished from 
^ the latter. Further, since the prospective abnormal shadows 
;il5 as detected by the iris filter processing are divided into 
IZ_ normalcy, malignancy (cancer) and benignancy (not cancer 

though being an abnormal shadow) and displayed in such a manner 
that whether the prospective abnormal shadows as detected by 
the iris filter processing are normal, malignant or benignant 
20 can be distinguished, it becomes feasible to distinguish a 
malignant shadow which should be treated at once or a 
prospective abnormal shadow which should be watched though 
need not be treated at once, which contributes to diagnosis. 

In Japanese Unexamined Patent Publication No. 
25 9 (1997) -167238, the Mahalanobis distance from the pattern of 
a normal shadow and that from the pattern of an abnormal shadow 
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(the Mahalanobis distance from an abnormal tissue distribution 
including both benignancy and malignancy) are compared with 
each other. This only contributes to increasing accuracy in 
detecting prospective abnormal shadows and cannot 
5 discriminate malignancy and benignancy from each other. To 
the contrast, in the prospective abnormal shadow detecting 
system 1 of this embodiment, since the Mahalanobis distance 
from the malignant distribution and the Mahalanobis distance 
from the benignant distribution are calculated separately from 

10 each other, accuracy in detecting the prospective abnormal 
shadows is increased and at the same time, malignancy and 
benignancy can be discriminated from each other. 

Further, since the indexes on the basis of which 
prospective abnormal shadows are extracted and/or the margins 

15 of the indexes K against the respective threshold values T are 
displayed together with the overall mammogram and the 
prospective abnormal shadows, the shadow reader can be 
provided with more detailed information on the prospective 
abnormal shadows. 

20 Though a prospective abnormal shadow detecting system 

in accordance with a preferred embodiment of the present 
invention is described above, the present invention need not 
be limited to the preferred invention but may be variously 
modified . 

25 For example, though, in the embodiment described above, 

the Mahalanobis distance is employed as the evaluation 
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function for determining whether the prospective abnormal 
shadow is normal, malignant or benignant, other evaluation 
functions may be used. 

The prospective abnormal shadow can be expressed in an 
5 n-dimensional pattern space using values on n - dimensional 
feature axes corresponding to n-dimensional feature values xl, 
x2, x3, ■", xn. Provided that resemblance between input shadow 
patterns is kept sufficient in the n-dimensional pattern space 
thus obtained, that is, similar shadow patterns are close to 
~ 10 each other even in the pattern space, features can be extracted 
and whether the shadow is malignant or benignant can be known 
by the use of, for instance, an evaluation function value 
(distance function value) representing a concept of distance 
taking into account spread of shadow patterns and the like. 
15 The Mahalanobis distance used in the embodiment described 
=~ above is a typical evaluation function value representing a 
distance taking into account spread of shadow patterns. 
However, a city block distance, a chess-board distance, a 
Minkowski distance or the like may be employed in place of the 
20 Mahalanobis distance. 

Evaluation function values other than those 
representing a concept of distance can be employed. For 
example, Fisher's discrimination functions for benignancy and 
malignancy may be employed as disclosed, for instance, in 
25 Japanese Unexamined Patent Publication No. 9 ( 1997 ) - 1 67 2 3 8 . 
In this case, in step B6 in Figure 2, scalars on both benignancy 
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and malignancy of the respective prospective abnormal shadows 
as detected by the iris filter processing are calculated 
according to a predetermined formula and are respectively 
compared with a benignancy threshold value and a malignancy 
5 threshold value which are empirically set through 
investigation of lots of benignant abnormal shadows and lots 
of malignant abnormal shadows. 

Further, though in the embodiment described above, 
indexes on edge information only are employed, for example, 
i" 10 indexes on histogram information or a combination of some 
%y indexes on histogram information and some indexes on edge 

IlI information may be employed in setting evaluation function 

=P values for benignancy and malignancy. 

s Also in these modifications, likelihood ratios may be 

M15 employed in the manner similar to that in the embodiment 
M= described above. 

Further, though, in the embodiment described above, 
whether prospective growth shadows as detected by the iris 
filter processing is normal, malignant or benignant is judged, 
20 for instance, whether prospective calcification shadows as 
detected by the morphology filter processing is normal, 
malignant or benignant may be judged. 

Further, though in the embodiment described above, 
whether prospective abnormal shadows as detected by the iris 
25 filter processing is normal, malignant or benignant is judged, 
the prospective abnormal shadows may be divided only into 
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malignancy and benignancy (including normalcy in this case) . 

Further, though in the embodiment described above, the 
present invention is applied to a mammogram, the present 
invention may be applied to any other radiation images such 
5 as a stomach radiation image. 
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